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Wit 



METHOD FOR ADMITTING AN ADMISSIONS APPLICANT INTO AN 

academic iKSTrrunnN 

*m>*vn<>?. jam ,r- qaskiu, 

1, Jean C. Gaakill, being duly sworn, hereby declare: 

1. I hold a B.A. in International Relations from the University of Southern California 
ID. from the University of San Francisco School of Law. 



2. Since 1972 I have been a member of the Boaxd of Reappraises for the California 
Corahuttee of Bar Examiners. I have aerved as the Chair of the Board of Reappraises since 
1996 The Board of Reapprai&erfl la ^responsible far, anKing other things, the grading of die eemi- 
aanuid California General Bar B*am. The grading process Include establishing and 
tmpU amentmg grading critaia and training, supervising, and calibrating 12 to 15 gradets per 
quasi on on essay question and performance teat items. 

3. From 1987 until 2004, 1 waa a member of the National Conference of Bar Examined 
Multttatc Essay Examination (MEE) Drafting committee. This group is respongible Ibr, among 
other things* establishing grading guidelines for the semiannual administration of the seven- 
quest on MEE, which is used by approximately a dozen bar examining jurisdictions. During this 
time; X was the leader of the semi-annual grading workshops convened after cash test 
adxnu istrution where graders from jurisdictions using the MEE were trained and calibrated. 

4. At various time? since 1993, 1 have consulted with Virginia, Ohio, Texas, Delaware, 
Alabskna, and Hawaii on the development of grading methodologies, including calibrated 
gradil g, for questions used on their bar examinations. 
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and 



5. 1 have substantial expertise in tbe field of grading methodologies used to consistently 
reliably grade owns, including essay exams, given to large numbers of test takos. I 



sntb aired the attached article which describes a methodology for calibrated grading. See GaslriU, 



J.C. 



A Model for Grading Bar Examination Essay Questions* The Bar Examiner (Feb 1996). 



6. Calibrated grading is * well known term of art among individuals who participate in 
the Administration and grading of examinations, suck as ok ay exams, Out require more than one 



grad a* to subjectively assess a largo number of exams. As used in this sense, "calibration" is the 
proo »s& graders go through in order that different graders will use consistent standards when 
evaluating exams. In particular, a successful calibrated grading process will calibrate the graders 
so dot each grader would give a particular exam qppwnrimarriy flic same ranking or score. 
Caltt radon also insures that a single grader would give a particular exam answer the same rating 
or sc *re if that grader were asked to grade multiple answers to the same exam question. 

7, Calibrated grading is generally used to achieve one of two results- The first is an 
absolute calibration where a numerical score is assigned to each exam being evaluated. An 
exan pie would be a grading scale where the correct answer is broken down into multiple issues 
and <ach issue is assigned a specific number of potential points. Tbe teat taker earns points by 
addressing issues deemed important by tb* test writer and by thoroughly and correctly 
addressing the issue. In this type of calibration* an exam answer should be assigned the same 
numerical score regardless of which grader evaluates the exam answer and regardless of how 
other test takers perform on the same ekam question. Once scores are assigned far all of the 
exmq answers; it i* possible to place each of the individual test takers within the appropriate 
percentiles. 

8. The second result is where die scores are force ranked relative to one another. In this 
proceks, as each answer is graded it is ranked against all of the other answers that have been 
grade L Using this approach, the end resuh will be a ranking of the teat takers relative to one 
another. Once tbe ranking is completed for all of the exams, it is possible to place each of the 
individual test takers within appropriate percentiles , 
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9. bi a typical absolute catibr&uon process, the graders ore given * model answer and a 
gradng guideline far each question they will be grading- A calibrator will then review the 
quee ion, a model answer, and a grading guideline with die entire group of gradro. Once the 
grad sre become familiar with die question and the model answer, each grader is given a copy of 
an e s$y answer to grade according to the grading guideline* Hie graders then reveal die scores 
thai each has assigned to die answer. The calibrator facilitates a discussion with the graders 
wheac each grader reveals the grade they assigned and the reasoning behind die assigned grade, 
Wh£ re there am differences between the graders, the calibrator works with the group to find a 
uriftrro approach. In a typical calibration process, each grader i* asked to grade the same group 
of I< to 20 different answers and compare the grade they assign for each answer with the grades 
aasig aed by the oifcer graders. After following this process, the grade the graders areign to each 
answer typically converges on a single score. For a more detailed discussion of this process, see 
the attached article tided. A Model for Grading Bar Examination Essay Question*. 

10. I hove no financial interest in the Harbaogh patent application (Application No. 
09/8^6,690) or any relaxed application*. I am not being paid for my services pertaining to the 

rof ttna declaration. 




Stale of Call 
County of 



1 HEREBY CERTIFY that in this day, before rue, sen officer duly authorized to 
administer oaths, personally appeared Jean C. GatidU, who is personally known 



tome 



the 



_ has produced a driver's license as identification, was duly sworn to Tell 

tr^th, and having done so, says that the foregoing statements are true and correct: 

IN WITNESS WHEREOF I set my signature and official seal this J y* 1 day of 



:0Q5 




NOTARY PUBLIC 
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